Exploratory analysis of benchmark experiments an interactive approach
نویسندگان
چکیده
منابع مشابه
Exploratory Analysis of Benchmark Experiments – An Interactive Approach
The analysis of benchmark experiments consists in a large part of exploratory methods, especially visualizations. In Eugster et al. [2008] we presented a comprehensive toolbox including the bench plot. This plot visualizes the behavior of the algorithms on the individual drawn learning and test samples according to specific performance measures. In this paper we show an interactive version of t...
متن کاملExploratory and Inferential Analysis of Benchmark Experiments
Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce a comprehensive toolbox of exploratory and inferential analysis methods for benchmark experiments based on one or more data sets. We present new visualization techniques, show how formal non-par...
متن کاملDomain-Based Benchmark Experiments: Exploratory and Inferential Analysis
Benchmark experiments are the method of choice to compare learning algorithms empirically. For collections of data sets, the empirical performance distributions of a set of learning algorithms are estimated, compared, and ordered. Usually this is done for each data set separately. The present manuscript extends this single data set-based approach to a joint analysis for the complete collection,...
متن کاملDevelopment and Analysis of an Interactive Physical Modeling Benchmark Set
The goal of this work is to gain an understanding of the execution characteristics of certain interactive simulations. In order to achieve this, we collected a small benchmark set of physical modeling simulation applications 1. We then extended these to include a userspecified level of detail parameter. Lastly, we explored the behavior of these applications through the SimpleScalar processor si...
متن کاملThe Design and Analysis of Benchmark Experiments
The assessment of the performance of learners by means of benchmark experiments is an established exercise. In practice, benchmark studies are a tool to compare the performance of several competing algorithms for a certain learning problem. Cross-validation or resampling techniques are commonly used to derive point estimates of the performances which are compared to identify algorithms with goo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computational Statistics
سال: 2011
ISSN: 0943-4062,1613-9658
DOI: 10.1007/s00180-010-0227-z